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I . INTRODUCTION 

One of the most fundcunental concepts in systems theory is 
the basic definition of a dynamic system. A dynamic system 
may be defined as an interconnection of entities (which we 


X 
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■hall call "componenta*) causally related in tine. It seoM 
equally natural and basic, therefore, to characterize the 
system's behavior in terms of contributions from each of the 
system's building blocks — "components.” The performance of 
the dynamic system is quite often evaluated in terms of scmte 
performance metric we choose to call the "cost function y , 

The cost function might represent the systmn energy or a norm 
of the output errors over some Interval of time. Concerning 
the physical or math^atical components of the syst^, it is 
only natural then to ask question CC: "Mhat fraction of the 

overall system cost V is due to each component of the system?" 

This chapter is devoted to a precise answer to question CC 
and to several applications of the mathematical machinery de- 
veloped for answering the question. Such an analysis will be 
called aomponent cost analyeie (CCA). Conceptually, it is 
easy to imagine several uses for CCiV. 

(a) Knowledge of the magnitude of each component's con- 
tribution to the system performance can be used to suggest 
which components might be redesigned if better performance is 
needed. By redesigning so as to reduce the cost associated 
with these "critical" components (those with larger contribu- 
tions to system performance) , one is following a "cost- 
balancing" strategy for system design. Thus, CCA can be use- 
ful in system design strategies. 

(b) Knowledge of the magnitude of each component's 
contribution to the system performance can be used to predict 
the performance degradation in the event of a failure of any 
component. ThuSt CCA can be useful in failure mode analysis. 
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(c) KnowlcHlge of the magnitude of each component '■ 
contribution to the performance of a higher order model of the 
system can be used to decide which components to delete from 
the model to produce lower order models. Thua, CCA ean ba 
uaaful in modal raduotion, 

(d) Alternately, if one defines the ccsnponents to include 
each dynamical element of a linear feedback controller, the 
knowledge of the magnitude of each component's contribution to 
the closed-loop system performance can be used to determine 

t 

which dynamical elements of the controller to delete so as to 
cause the smallest change in performance which respect to the 
performance of the high-order controller. Thua, CCA oan ha 
uaaful in tha design of low-ordar oontrollaTa that meet on- 
line controller software limitations. 

This chapter will focus on possibility (c) in some detail. 

This notion of using a performance metric is basic in the 
roost well-developed and simplest problem of optimal control: 
the linear quadratic problem. However, one of the fundamental 
deficiencies of modern control theory is its absolute reliance 
on the fidelity of the mathematical model of the underlying 
physical system, which is essentially Infinte dimensional. 

Many "failures" of modern control applications are due to 
modeling errors. Thus, theories that can more syst^atically 
relate the modeling problem and the control problem are sorely 
needed since these two problems are not truly separable, al- 
though most practice and theory presently treat them as 
separable. This chapter presents one such unifying theory and 
can be viewed as an application chapter in the sense tl. it 
is concerned with making the linear quadratic theory more 


praotioal. Thus, the proposed insights into the behavior of 
dynamic systons are available within the standard mathematical 
tools of linear quadratic and linear quadratic Gaussian (LQ6) 
theories [6]. Hence, the contributions of CCA lie not in the 
development of new math^atical theories, but in the presenta- 
tion of cost decomposition procedures that readily reveal the 
"price” of system components. A similar notion of "pricing" 
of system components is a common strategy in operations re- 
search and mathematical programming problems such as Dantzig- 

t 

Wolfe decomposition and the dual algorithm by Benders [1,2]. 
However, such useful notions of pricing se^ not to have found 
their way into common control practice. This paper calls 
attention to the manner in which such notions can be used in 
dynamic systems. The mathematical details are quite different 
from the pricing of the static models of operations research, 
but the concepts are similar. 

The concepts of CCA evolved in a series of presentations 
[■^-5], However, these introductory papers left unanswered the 
most important questions of stability, the best choice of co- 
ordinates, and development of the theory of minimal realiza- 
tions with respect to quadratic performance metrics. This 
chapter, therefore, presents a complete theory for CCA and, in 
addition, develops the theory of minimal realizations with 
respect to quadratic performance metrics. 

II. COMPONENT DESCRIPTIONS 

The entities that compose dynamic systems are herein 
labeled "components." To illustrate the flexibility in the 
definition of components consider example 1. 




s 




Example 1, Lat the vertical notion of a throttlable 
rocket be described by 

nv > f - mg, (la) 

where m la the assumed constant mass, g Is the gravitational 
constant, and f is the rocket thrust that Is regulated by a 
fuel valve with the dynamics 

f ■ af + u (lb) 

for a given command u. Thus, for the system 



( 2 ) 


the v9hiole dynamioa (la) with state v might be chosen as one 
system component, and the valve dynamice (lb) with state f 
might be chosen as another ccxnponent. In this case one might 
wish to ascertain the relative contribution of the dynamics of 
the vehicle and the dynamics of the valve In the overall 
system performance metric 


V 



f^(t)dt + (v(T) “ 



(3) 


where T is the terminal time at which the velocity v(T) * v is 
desired. 

Alternatively, one may define components of (2) in any 
transformed set of coordinates of (2) . For example, one might 
wish to know the relative contribution In (3) of the modal 
coordinates of (2), In which case the system components are 
and q 2 described by 
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As described In the Introduction, "cosqponent cost enelysiiT 
(CCA) , is the procedure developed for answering question CC 
for any choice of component definitions. In the special case 
where the components are modal coordinates, the procedure is 
called "modal cost analysis" (MCA) [4] . It is possible to use 
CCA with any choice of component definitions including the 
"balanced" coordinates of Moore [7], the "output-dacoupled" 
coordinates used in Tse et al. [8], etc. For any choice of 



Fig, 1. Component definitions . 
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coordinate* the n exponents may be described in the form 
n 


»i- S 




j-1 

n 


(5) 


y - I CjXj- 
j-1 

For notational convenience, we shall later need to differ- 
entiate between the definitions of coordinates, components, 
and subsystems. These distinctions can best be introduced via 
example. A certain system has state x. Let the symbols x^, 
Xi, all represent partitions of the state vector to various 

levels of detail. The scalars i * If*# N, will be 

ni 

called coordinates. The vectors x^cR ,i«l,..., n, will 

Ni 

be called the states of the components and e R , 
s, will be called the states of the subsystems. Then for 
n * 3, s “ 


'Xl' 





^2 
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(■ 


n 


S^i - S»*i)- 

i-1 i«l 


(6) 


As an example of component definitions, consider Fig. 1, 
where dynamic elcunents x^, i > 1,... 12, and their inter- 

connections are described. Each of these dynamic elements 
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a priori by the analyst) with stats i 12; 

la callwd a ccxnponent of the system. Rowever, each ccxaponent 
may have additional dynamical variables X2 »***' called 
coordinates. This coordinate view of the system is the mioro~ 
toopie view of the system, whereas, the view of certain col- 
lections of components, called subsystenu Is the maorotoopie 
view of i»ie system. For the example In Pi . 1, see fr<xn (6) 
that 



Of course, when the analyst chooses n^^ « 1 and 1, there 

la no distinction between coordinate, component, and subsystem. 

III. CONCEPTS OF COST DECOMPOSITION 


In our preliminary discussions, we presume that the linear 
ayetem model 

.n 


X ■ A(t)x + D(t)w, X « R 
y - C(t)x, 


y e R*', w e 


(8a) 

(8b) 


n. 


having oomponente x^ e R exieta for the purpoae of aoourately 
modeling the outputs y(t) over the interval 0 ^ t ^ T. To 
make this notion more precise, we construct the performance 
metric 

•T 


F(T) 


’ *|/o' 


Y(t)dt + Y(T) 


I- 


Y(t) A lly(t)||Q(tj ^ y’’(t)Q(t)y(t), 


( 9 ) 
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wh«r« Q(t) and Q(T) ara poaitlva dafinlta and aynnatric, and 
whara tha axpactad valua oparator E is naadad if aithar tha 
initial condition x(0) or tha diaturbanca w ia random. Tha 
baaic idaa of componant cost decomposition is illustrated by 
tha following example. 

2 

Example 2. Tha quadratic function of x e R given by 

V A X^QX - + *1*2^12 ^2*1®12 *2^22 

nay be decomposed into costs due to components x^ and x^ by 
defining the c<xnponent cost by 

''l ^ 3 ^ *1 ■ *l°ll * 

>'2 ^3^*2 - *2°22 * Vl0l2- ‘IIW 

Hence, the total cost is the sum of the ccxnponent costs 

• i ’'i' >'i • 3 ^ <«> 

i-i ^ 

where n ■ 2 in this example. 

To extend this component cost concept to the systems (8) 
and (9) , we must first specify the character of the excita- 
tions of (8) . The situation is now separately described for 
deterministic and stochastic inputs. 

A. COMPOKBET COSTS FOR STOCHASTIC SISTBMS 

Let any inputs w(t) that are correlated with time or state 
be described by a Gauss-Markov model. 

We will assume, however, in order to simplify notation, 
that w(t) in (8) is a zero-mean white noise process with in- 
tensity W(t) > 0 and that x(0) has covariance x(0) >. 0. 

The first definition follows tha lead provided by (10)- 

( 12 ). 
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Definition 2. Th« coaponsnt cost for tho 1th 001190 - 
n«nt of (5) and ( 8 ) with reapact to tha parforawnea Mtrio (9) 
la daflnad by 

»l(T> « ^ '«> 

Tiro Important propertlaa of tha componant coata V^(T) ara 

(a) tha auparpoaltlon property of conponant coata 
n 

V(T) - ^ l'i(T), (14) 


(b) the component coat formula 




xc'^’ocdt + X(T)C^(T)Q(T)C(T) 




where X la the atate covariance aatiafylng 

X ■ AX XA^ + DWd’’, X(0) - Xq» (16) 

and denotea the n^^ * n^ matrix correapondlng to the 

position of in x. 

Theae reaulta allow one to examine individual component 
contributions in a variety of situations involving ( 1 ) apaoi- 
fied times T, (li) epeoified time intervale t e (0, T] , and 
(ill) time~varying eyeteme. Examples of situation (1) in- 
cludes circumstances in which the system goes through 
"critical" times T, and at this time it is required to have 
more precise )cnowledge about the dynamical interactions of the 
system conponents than at other times. Soma critical times in 
engineering problems include 

(11) spacecraft reentry time T, 

(12) time of rendezvous T of tiro spacecraft, 

(13) critical times T in a nuclear reactor. 
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(14) mritch-in or switch-out tine T of s powvr subststion 
in a Isrgar powsr nstwork, and 

(15) tima T of maximum dynamic prasaura of an aircraft or 
roc)cat. 

Exan^las of situation (ii) Include finita-tima control 
problanwi 

(111) air-to-air raasile intercept; quidance of a roc)cat 
to orbital insertion, 

(112) rapid repositioning of a flexible space vehicle, 

(113) a finite ^-ime Industrial process. 

Examples of the time-varying cltuatlon (ill) are coionon and 
will not be enumerated. 

For time- invariant systems with T ->■ «*, (9) and (15) 
simplify to 


F(-)- lim EY(t) - tr X(»)C^QC, 

(17) 

t-« 


1 E Xj(t) 

(18a) 

- trtX(-*)C^QC)j^^, 

(18b) 


where X(«) exists if and only if the disturbable (controllable) 
modes of (A, D) are stable, and X(<*) is the positive definite 
solution of 

0 - AX(») X(-)A^ + DWD^ (19) 

if (A, 0) is a disturbable pair [6]. 

B. COMPOBEKT COSTS POP DETERMIBISTIC SJSTEMS 

If all disturbances are written in differential equation 

form ( 8) without the noise w, and with specified 
initial conditions, then we may simplify the form of (8) 
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and (9) to 

X • AXf 


x(0) 


Cx, 


V(T, - ij/J Y(t)dt + Y(T) 
and (16) becomes 
V 


1 - 


(20) 

(21) 




( 22 ) 


where (15) still holds except that (16) is now replaced by 

X • AX + Xa’’, X(0) ^ x(0)x'^(0),' (23) 

which has nontrivial solutions X(t) , t e [0, T] , for finite T. 

Example S. A finite-time deterministic problem. 

For the example (2) , find the component costs for vehicle 
and actuator components v(t) and f(t), if T ~ 1000, m ^ i, 
a “ -1, V = 100, v(0) = 0, f(0) “ 0, g » 9.8, and u « 1 is a 
step input. The deterministic model of the inputs augmented 
to ( 2 ) yields ( 20 ), where 



x( 0 ) 


0 1 /m -1 "l 

0 a 1/9.8 1 , y. ~ 

0 0 0 _ 

Putting (3) into the form (20) leads to 

C(t) » to 1 01, Q(t) - 1, 0 <. t < T 

C(T) - [1 0 0], Q(T) « 1. 

Solving (15), subject to (23), yields for (22), 

Vj^(T) » 7.92 X 10*, F 2 (T) » 1.00, F 3 (T) 


f-100\ 
0 

\ 9.8 


0 , 


where Kj^(T)//(T) 


0.9999 is the fraction of the cost associ- 

-5 


ated with vehicle dynamics, F 2 (T)/F(T) ■ 1.27 x 10 is the 
fraction of the cost associated with actuator dynamics, and 


/a. 
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V^{T) /V{T) * 0 is the fraction of the cost due to the biases 
in the system (gravity) . Clearly the vehicle dynasties domi- 
nate the performance. 


C, ISPIKITS-TIME DETERMINISTIC PROBLEMS 

in the liodt T -*• «, (21) yields F(T) « 0 if A is asyEq>- 
totically stable. Hence, a different performance metric and 
component cost definition is required for the special case of 
infinite- time determinietie probleme. An appropriate cost 
function for this case is 


Vd(-) 



Y{t)dt, 


(24) 


Which leads to 

Yp(«) = XqKXq, 0 = KA + a'^^K + C^QC, (25) 

where K exists if and only if the observable modes of (A, C) 
are stable, and K is positive definite if (A, C) is observable. 
Here the component cost associated with component i is de- 
fined as the net effect of the excitation of the 1th conqoonent 
state x^. Hence, in this case the excitation is Xj^(O) and the 
component cost is defined by 

37 (a) ^ 

^ j = l 

(26) 

= tr[Kx(0)x^(0)lj^^, 

where K satisfies (28) . 

The remainder of this chapter will focus on the etoohaetia 
problem rather than the deterministic problem of Section III.C. 
This means that the "output-induced" component costs (18) will 
be of interest, rather than the "input- induced" definitions of 
(26) . The reader can find details of an input-induced 
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conqEK>n«nt cost for stochastic systeas in t5 ] , which, for 
deterministic problems, is based upon (26), and for the sto- 
chastic problea 


V • B f Y(t)dt, X = Ax, Sx(0)x***(0) - X(0), (27) 

Jq 

[5] utilizes the stochastic version of the component cost 
definition (26) whose calculation is 

- trlKX(O)]^^. (28) 


For the stochastic problem 

V = lim FY(t), X = Ax+ Dw, ffw(t)w^(T) = W6 (t - t) 

y = Cx, Y 4 ||y(|2 

(5] utilizes the input-induced component cost definition 

Fi ^ y lim F ^ k D^w 

i 

whose calculation is 
= tr [KDWeS^j^. 


(29) 


(30) 


(31) 


The input -induced definitions (30) of component costs 
represent the effect in F of excitations of component i, 
whereas the output-induced definitions (13) and (18) represent 
the total contributions of in F in the presence of all ex- 
citations. The latter and more recent definition se^s to be 
a much more complete notion of the contribution of component 
in the system cost while the system is subject to all its 
natural environmental disturbances. Hence, this chapter will 
present a theory only for output- induced definitions of com- 
ponent cost, although the same procedures could be used to 
wor)c out a corresponding theory for the input-induced case. 

To further simplify the presentation, only time- invariant 
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systMM with infinite teminal time T will be treated in de- 
tail. The application of the concepts to the finite-time case 
will be straightforward. 

IV. BASIC THEOREMS OF COMPONENT COST 
ANALYSIS FOR MODEL REDUCTION 

Given the time-invariant linear syston 


X * Ax + Dw, y = 

Cx, 

(32) 

V - Urn f||y(t)||2 

Q > 0 

(33) 


« 


with components described by (5) , and with zero-mean white 

noise disturbances w(t) 

with intensity W, then the 

value of 

1 

ccxnponent i whose state 

Hi 

is Xj^ e R has been shown 

in previous 

sections to be 



= tr[Xc’‘oci^^, 

0 = AX + XA^ + DWd’’ 

(34) 


and is called the ith component cost. The fractional part 
of the ith component's contribution to F is V^/V, where 
V » ^j*i This component cost Information (34) might be 

useful to guide system redesigns, failure mode analysis, and 
model reductions as mentioned in the Introduction. In the 
context of model reduction there may be considerable freedom 
in the selection of coordinates before model reduction begins. 
That is to say the definition of components is up to the 
analyst. For any selected component definition, the model re- 
duction scheme proposed is simply to discard (truncate) some 
of the component equations (5). Suppose the component index i 
belongs to the set R(i e R) corresponding to the rttain^d com- 
ponents x^, and i e 7 denotes the set of indices associated 
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with the tnincated (deleted) component equations. The reduced 
model is 


*R “ Vr ^R * « 

r 

f * ‘=R*R- "r * 2 "l 

i=l 


(35) 


where Aj^ is composed of the set {i e /?} of columns and rows of 
Ar is composed of the set {i e i?) of rows of Dr and Cj^ is 
ccHnposed of the set {i e Jt) of columns of C. The set Jf is de- 
termined by those r integers (here denoted generically by 1 r 
2r...r r) associated with the r largest component costs 




^ ‘'r ^ ^rtl ^ 


^ ^n* 


(36) 


The CCA algorithm for model reduction is therefore character- 
ized by these two basic steps: 

The Baeio CCA model reduction algorithm 
I. Compute component costs by (34) and rank according 
to (36). 

II. Delete the n - r components associated with the n - r 
smallest component costs. The resulting model is (35) . 

The remainder of the chapter seeks to characterize various 
mathematical properties of this CCA algorithm. This is clearly 
necessary since it is not apparent at this point whether the 
CCA algorithm produces "good” reduced models. To address this 
question of model errorR we shall define a model error index Q 
in Section VI. But first a brief review of modal coordinates 


is in order. 


V. MODAL COST ANALYSIS (MCA) 


There is an important caae in which the input- and output- 
induced definition of ccmiponent costs yield the same result, 
and this case is summarized below. 

Propoeition 1, Consider system (29) where is the ith 
modal coordinate and assume for convenience that A has 
distinct eigenvalues. Hence, A is diagonal. Then the CCA 
algorithm will produce the same reduced model, whether the 
output- induced or the input-induced modal cost definitions, 
(18a) or (30), respectively, are used. 

Proof. To prove this result we must show that the compo- 
nent costs as computed by (18b) and (31) are identical if A^^^ 
in (5) has the property A^j » ^i^ij* we shall show that 

for all real 

» [XC*QC)^^ - [KDWD*]^^ for all i • 1,..., n, (37) 


where X and K satisfy 

0 » XA* + AX + DWD*, 

0 » KA + A*K + C*QC, 
when “ ^i^ij* complex notation * is required due to 

the complex matrices A, D, and C. It is well known [6] that 

* 

the total cost is the same by either calculation Y * tr XC QC 

or K « tr KDWD*, but the issue here is whether eaoh modal cost 

* 

(37) is the same. Denoting the ith row of D by d^ and the ith 
column of C by Cj^, the solutions of (38) and (39), respec- 
tively, are 


D s complex conjugate 
transpose 

* (D)'*’ 


(38) 


(39) 


- -dJwdj/(X^ + X^) , 


(40) 






( 41 ) 


Ntt also resMtrk that node 1 is observable (disturbable) i£ and 
only if c^(dj^) is not zero. Use (40) and (41) to obtain, 
respectively, 

n 

[XC*(X:lii - “djw Qc, (42) 


[KDWD*] 


11 



(43) 


Since the complex number on the right-hand side of (42) Is the 
conjugate of the complex number on the right-hand side of (43), 
(37) is therefore verified for the special case of real eigen- 
values of A. For a particular complex eigenvalue let 

Equations (42) and (43) show that the ccxnponent 
cost of any x^ associated with a complex eigenvalue X^ will be 
a c<xnplex number and that the component cost of corre- 

sponding to the eigenvalue X^^^^ » will be the complex con- 
jugate of 7^. That is ^1^1 “ ^i and 7^ have the same norm. 
Hence, replacing 7^^ by |7j^| in the CCA (presently MCA) trunca- 
tion rule (36) , the MCA model reduction algorithm would always 
truncate modal components so that complex conjugate paire of 
eigenvalues are truncated. Note also that in the case of 
proposition 1, n^^ » 1 and for a complex conjugate pair 
X. 


' 1+1 


X^, it is true that 


^+1 ^ ^i 


2Re7 


i* 


(44) 


Hence, the total cost 7 is real, and the sum of the modal cost 
of any two modal components associated with ccxnplex conjugate 
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pairs of alganvaluas will ba raal. Tha proof is concludad by 
noting that ccxnplax conjugatas ara truncatad in pairs and fron 
tha fact 

a 


CXC - IXC QC]^^ - IKDWD 

we conclude that for a complex pair 

^+1 - lXC*QC)ii f CXC*QC1^^^ 


(45) 


- (KDWD*!^^ + (46) 

Hence the same modes will be truncated by either definition of 
modal cost. # 

Under special conditions the modal costs (42) emd (43) 
simplify greatly. 

Propoeition 2. If either (a), (b) , or (c) holds: 

* 

(a) d^Wd^ * 0, i j (disturbance decoupled modes); 

* 

(b) c^QCj *0, i 3^ j (output decoupled modes) ; 

(c) (ReXj^/Imlj^) arbitrarily small, and (lightly 

damped modes ) ; 


then the modal costs of a linear system are given by 




■'i * 


* * 

c^Qc^d^Wd^ 


- - ^ll=illSI|ai 


|2 

■w' 


(47) 


which holds for either the input-induced definition (30) or 
the output-induced definition of modal cost and where V is de- 
fined by (29). If is real, then the ith modal cost is 



The proof of parts (a) and (b) follow Immediately from 
(42) and (43). The proof of part (c) is given in [5). I 
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Examples of case (c) in proposition 2 appear in (5] and 

[17] where NCA is applied to systems of order up to 200. It 

should be noted that since the MCA formulas (47) are explicit 

[hence, the linear matrix Eq. (38) does not have to be solved 

numerically ] , the MCA algorithm may be applied to any syst«n 

for which modal data are available. It will subsequently be 

shown that modal coordinates might not be the best coordinates 

in which to perform model truncation. However, much insight 

is available from (47) indicating that modal costs are com- 

« 

posed of the product of three properties of a mode: (I) time 

constant, (2) observability norm, and (3) disturbability norm. 


VI. MODEL ERROR INDICES 

Having a reduced model (35), we now turn our attention to 
the definition and calculation of a convenient measure of 
"model error" when comparing the reduced model (35) with the 
evaluation model (32) . 

Definition 2. The errors associated with model (35) 
produced by the CCA algorithm are measured by the model error 
index 

fl ^ pi O' - I . U8) 

where ie the performance metric associated with (35) . If 
the disturbable modes of (Ap, D^) are stable, then 

■'* ■ VSoCr' 0 - <«> 

and V is the performance metric associated with the "evalua- 
tion” model (32), as given by (33). 

Of course, I'p can be computed only after model reduction. 
The information available a priori will be called the predie- 
ted model error index 
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Definition 5. The pradlcved ntodttl arror indax la dafinad 


by 


$ A - \)\, 


where 


Vjj A IV^, i t E. 


(50) 


(51) 


From (36), (50), and (51), It follows also that 

^ ^ < 52 ) 


and 


^ /V 


(53) 


Whan applying the model error index Q to the reduction of the 
aZca«d-loop system (to reduce controllers rather than models), 
Q plays a role similar to the "suboptlmallty Index" of Slljak 
[14]. Note also that the Q chosen here (48) Is the difference 
in the norms of y and y, whereas the model error Index chosen 
In [5] Is the norm of the difference y - y. This choice (48) 
is primarily motivated by the controller reduction problem 
where represents the performance using the reduced control- 
ler. In that problem since represents the sub- 

optimal controller perf romance. Since is minimized if Q is 
minimized, the difference of norms represented by (48) is a 
more logical choice for controller reducti:>n. This paper now 
focuses on the prerequisite problem of imxiel reduction where 
all the essential mathematical results ate derived for subse- 
quent application to controller reduction. 

For the model reduction problem, the model error index (48) 
would be a meaningless index if the parameters of the reduced 
C^) were arbitrary, since in this case param- 
eters can always be found to ma)ce 9 « 0. Reasonableness is 


model (Aj^, Djj, 


. ^ T 


added to the problon, however, by the fact that the eearoh for 
email Q ia aubjected to the paranetera (Aj^, D|^, C|^) , which are 
oon* trained to be a tranaformed aubaet of the original ayatem 
parameters (A, D, C) . He now continue with thia model reduc- 
tion problem. 

The queationa that naturally arise and are to be answered 
in the sequel are 

(QI) Under what conditions is the predicted model error 
index Q exact (Q ■■ Q)7 

(QII) Under what conditions is the model error index Q 

zero? 

(QIII) Under what conditions is the model error index Q 
minimized by the CCA algorithm? 

(QIV) Given that A is stable, under what conditions is 
the reduced model produced by CCA stable? 

VII. COST-EQUiVALENT REALIZATIONS AND MINIMAL 
REALIZATIONS HITO RESPECT TO CC^T 

Toward the development of the mathematical machinery 
required to answer questions (QI)-(QIV), we introduce the 
following definitions. 

Definition 4, Coet-^equivalent realinatione 

Let {Aj^, Dj^, Cj^, Xjj(O), Wj^} characterize the partial 
realization (35) and let (A, D, C, X(0) , W} characterize the 
evaluation model ("ccxnplete” realization) (32). The partial 
realization is said to be cost-equivalent if g • 0. 

Definition S. Minimal cost-equivalent realisations 

With respect to the given components (5), the partial 
realization (35) is said to be a minimal cost-equivalent 
realization if r is the smallest integer for which Q * 0. 
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To ■laqplify our bookkooping, lot uo oootsM that tho ooa- 
pononto (5) oro arrongod in ordor of thoir conponont coats and 
dofina 


Xjj ^ ( « » » / X f » » ») t i* Jf ^ 

X^ ^ ( • • • f X^ f t m t) f i. t T* 

Than (32) may ba %rrlttan in tha form 



L°TJ 


(S4a) 

(54b) 


(55) 


Lot X as defined by (34) be likewise partitioned in tha manner 


X 




(56) 


Due to symmetry of X, the partitioned form of the linear aqua- 
tion (34) using (55) and (56) yields thraa linear equations of 
smaller dimensions. Two of these equations are 


0 - *]t^T * * VtR 

« ' »T*T * V? ♦ + D,WD* (57b) 

A 

The remaining equation in X^ is subtracted from (49) to yield 




where SL A i - r. 


(57c) 
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4. AM8VER8 TO QUS8TI0MS QI, QII, AMO QIIX 

Using th« abovm synbolnf quMtior. QI can now b« anawarad. 
Proposition S. Tha pradiotad nodal arror Indax § ia 
axact in tha aanaa ^ • Q undar any of tha following conditional 

(a) if tr(S?jjCjQCR ^tCJqCjj) - 0 and V > (58a) 

(b) if tr \cJqCr + tr 23 ^.cJqC^ + tr 

- 0 and V < Kpi (58b) 

(c) if 5^ - 0; 

(d) if is unobservable; 

(e) if is undisturbeU>le. 

Proof. Noting (49) and (50), it follows that the proof 
requires that if I' ^ amS requires that 2F > 

ir F < 7p. To show that Fj^ ■ F^ when (58a) holds, we first 
write from (34), using (55) and (56), 

\ - |tr IXC^OCl - tr(VjQC^ + *RT=?«=J' i • " 

■ «{<*R ♦ **>=S0Cr * 

Now subtract (49) fron (59) to obtain (58a) directly. To 
prove (58b), write, using (34), (55), and (56), 

F - tr XjjCJqCj^ + 2 tr Xj^^cJqCj^ + tr X^cJ(JC^. (60) 

Substitute (60) into 2F * F^^ F^^, using (49/ and (59) to get 

j(tr XjCjoCg ♦ tr 2V?°=R * 

- VX * VS«R ♦ W?«=R- 


I 


I 
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%fhich r«duoM to (58b). To p?ov« (c) , sot Xj^ - 0 in (57c) to 
obtain 3^ ■ 0* Fxurthamora ainca ■ 0, .wa hava fron (80) 
and (49) 

- ''r • « VS»=R ♦ “ - « Vr»=R 

- tr Stj^cJoCj^ + tr X^cJqC^ - tr I^cJqC^ 

Now, ainca tha atata covarlanca X la at laaat poaltiva aani> 
dafinlta {6], X^ >. 0 and hanca V ^ . Hanca, (58a) ia 

applicable, and thin provaa (c) . To prove (d) , one nay with- 
out loss of generality aasune Aj^ ■ 0 and » 0 since is 
unobservable. This yields fron (57c) « 0, which iraaadiataly 

leads to (58), since ■ 0. To prove (a), assume is un- 
disturbabla (i.a., set A^^^ <■ 0, * 0). This yields from 

(57a) and (57b) yields Xr - 0. 

Hanca, condition (58) is again satisfied, t 

It may be comforting to know that tha predicted modal 
error index is accurate, but the initial issue of the "best* 
clu>ice of coordinates and ccanponents is still unresolved. 

That is, some choice of coordinates may lead to smaller model 
error indices than other choices, even though the predicted 
iBodel error index may be exact for each choice. Before we try 
to resolve the question of the best set of coordinates, we 
shall define the limiting case where the reduced model is 
"perfect.” Thus, the following result answers question QXI. 

Propo 9 ition 4. The partial realization (35) is a cost- 
equivalent realization of (32) under either of these 
conditions: 


(a) if and only if 


( 62 ) 




ab 


(b) if is undt>servable; 

(c) if is undisturbable . 

Proof, Fr<xa (58 ) , it folloirs that proof of (a) rsliss 
upon a proof that K « if (62) holds. Subtract (49) frcxt 
(60) to get (62) directly. To prove (b) we rely on the proof 
of theorem 3, which showed that 0 if x^ is unobservable 

and that ^ q may be assumed. The conditions ^ * 0, " 

lead to satisfaction of (62). To prove (c) , note from the 
proof of theoroa 3 that 3^ * 0, » 0, 3^^ = 0 if x^ is un- 

disturbable. These substitutions in (62/) conclude the 
proof . f 

Having answered questions QI and QII, it is now possible 
to provide an answer to QIII. This answer is summarized by 
proposition 5. 

Proposition S. Given a specified r and the components 
(5 ) , which satisfy proposition 3 {Q ~ Q) , the model error in- 
dex Q is minimized by the CCA algorithm. 

Proof. Since $ “ C the model error index is given by 


(52). Among the set of {7^, i = 1, 2,... n}, the in (52) 
is composed {by definition) of the n - r smallest svibset of 
V^a, according to (35) . Hence, Q cannot be decreased by any 
other choice of r components from the given set of n compo- 
nents (5) . 4 

We must not read too much into proposition 5. It only 
guarantees that there are not better r choices of the given n 
components. The a priori choiaee of component definitions 
that can be made are infinite. In any model truncation prob- 
lem these three factors are important: 


0 


(a) choice of coordinates, 


(b) choice of a truncation criterion, and 

(c) choice of an evaluation criterion for the reduced 
nodel. 

In CCA, the best choice (a) has not yet been determined, 
choice (b) is given by (36) and (52) , and choice (c) is given 
by (48) . One suggestion for choice (a) is introduced in the 
next section. It should be noted, however, that depending 
upon the question being addressed, the analyst may not have a 
choice of coordinates. In this case the results of Section 

f 

VI I. A apply, but the coordinate transformation of Section 
VI I. B will not be permitted. 

B, COST-DECOUPLED COMPONENTS 

The previous section describes CCA for any given choice of 
components, and this flexibility is important for the analysis 
of component costs using physical components. However, in 
model reduction the analyst may be free to ohooeo the refer- 
ence coordinates and may not be restricted to the analysis of 
physical components. The component costs for some choices of 
components (i.e., choices associated with the underlying co- 
ordinate transformations) are more convenient to interpret 
than others. As an example of possible confusion, note that 
even though the sum of component costs is positive (14), an 

individual defined by (15) or (34) can be negative. All 
theormns of previous sections are still valid, but one might 
obtain better re'*.jced models by using absolute value signs 
around each in (36) . Clearly, such issues need not be of 
concern if all are proven to be nonnegative. The cost- 
decoupled components to be defined in this section will prove 
to have this property. 


It may also be observed from the basic ideas of (11 ) , from the 
general component cost formula (15) , and from the steady-state 
cases of (18) and (34) , that the con^nent costs and are 
not generally independent. That is, the ith component cost 
is influenced by cmponent j. This presents no problem for 
the in situ ccmtponent cost analysis for purposes other than 
model reduction. But for model reduction such dependence be- 
tween and Fj leads to errors in the predicted model quality 
index 2, since in this case the deletion of component j also 
modifies the cost of the retained component i. This nuisance 
can be xemoved by choosing components that have independent 
costs. Thus, the motivation for such component choices is to 
gain the property Q - Q of proposition 3. For the purposes of 
this section, define the oomponente e to be eaoh ooordi~ 
note of the cost-decoupled state X 2 . Hence = 1 for all i 
in this case. From part (c) of proposition 3, it is clear 
that uncorrelated components (i.e., =0, i j) yield the 

property 2 = Q. An additional property is added to obtain the 
"cost-decoupled” coordinates defined as follows. 

Definition 6. The "cost-decoupled" coordinates of a 

linear system are any coordinates for which the covariance X 

T 

and the state weighing C QC are both diagonal matrices. 

A convenient choice of cost-decoupled coordinates may be 
computed as follows. Let (x®, X", C®, A®, D®} represent an 
original set of coordinates and data, and let (x, X, C, A, D} 
represent the transformed data according to the transformation 

, 0 - X®A®^ + A®X® + D®WD®^ 


X® » ex 


t 


(63a) 
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whttre 6 
X* ■ 


®x®y ®x* ®y 


e e*^ 

XX 


®y ‘ Vy' 


(63b) 


(63c) 


Note that 9^ is the square root of the covariance matrix X*. 
The nonsingular diagonal matrix is arbitrary. The ortho- 
normal matrix of eigenvectors of 0C6^ is and the corre- 
sponding eigenvalues (which are also singular values [9] since 
the matrix is symmetric) are elements of the diagonal matrix 

In cost-decoupled coordinates y the system (32) is trans- 
formed by 


A = e“^e“^A*e e , 

y X x y 




D 

C = c*e^9y. 


(64a) 

(64b) 

(64c) 


The calculation of the steady-state covariance matrix of a 
stable system in cost-decoupled coordinates reveals that 

X = 

T 

and the atate weighting matrix [C QC] in the performance 
metric 

V = lim ^||y||o = tr xc'^QC 

t-H» ^ 


(65) 


is 


T 

C QC 


2 2 


( 66 ) 


Hence from (65 ) and (66 ) , 

k 

- tr Xc'*'qC = tr ^ ^i hx^’^Q^^x 1' 


i=l 


V 


(67a) 
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where denotes eigenvalue of and the summation is 

only up to hf since there are only k nonzero eigenvalues of 
T T 

QC6^, since rank C « k. Note that the component costs in 
cost'decoupled coordinates are 

*"i “ 

which leads to this simple interpretation of cost-decoupled 
coordinates and component costs; In coordinates (components) 
that are uncorrelated (Xj . = 0) and output decoupled ( [C QC]^^ 

= 0) , the component costs are the eigenvalues of the state- 
weighting matrix. In view of (67a) which holds for any there 

se&ns to be no disadvantage in the choice = I, although a 
different choice for will be chosen in Section VII. D for 
convenient comparisons with the work of others. Temporarily, 
we choose fiy = I. 

The useful properties of cost-decoupled coordinates are 
now summarized in the following proposition. 

Propoeition 6. In cost-decoupled coordinates, the full- 
order model (55) has the following properties: 

(1) >. 0 (the component costs are all nonnegative); 

(2) Ap has no eigenvalue in the open right half plane; 

(3) asymptotically stable if and only if the pair 
(Aj^, Dp) is disturbable. 

Proof. Claim (1) follows immediately from (67b) since 
^i “ 

To prove claim (2) and (3) , partition (65) (with Qy * I) as 


r ^ *RT 


) 

M 

0 

___l 

< 

< 

II 


L*rt *t. 


M 

0 


X « 


(69a) 


» 




Thia ravaala that ,3^^ « 0. Hence, writing the partloned fom 
of (34), partitioned ccunpatlbly with (55), yields 

0 - aJ + Aj^ + DRWD^r (69b) 


® - *?B * *RT * '«»=' 

0 - aJ + A^ + 


Either (A^, Dj^) is disturbable or not. If (A^^, D^^) is distur- 
bable, then the state covariance of (35) from (69b) is 


I 


e 




dt “ I 


(69e) 


and the finiteness of guarantees asymptotic stability of 

would not be bounded for unstable Aj^ under the disturb- 
ability assumption) . This proves the "if part of claim (3) . 
If (Ajj, Dj^) is not disturbable then there exists an ortho- 
normal transformation 




(70a) 


to take the system (35) to the controllable conical form 


pll 


■^11 

^12 

1 

rH 

X 

1— 


'^1 


* 




+ 


1 

<N 

•X 


0 

^22. 

1 

<N 

X 


0 



w 


(70b) 
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Where D^) is completely dlsturbable. Now (69b) becomes 


0 - + D^WdJf 

0 - Aj2' 


(71a) 


(71b) 


0 » Aj2 + A22» 


(71c) 


The eigenvalues of Aj^ are those of A^^ and A 22 * Since (A^^, 

Dj^) is disturbable and e «■ I < •, the 

eigenvalues of A^^ must lie in the open left-hand half plane 

by reasons mentioned above. The eigenvalues of A 22 must lie 

T 

on the imaginary axis since A 22 is skew- symmetric (A 22 ~ ~^22^ 
Hence, no eigenvalues of Aj^ can lie in the right-hand half 
plane but there are eigenvalues with zero real parts. This 
proves claim (2) . Moreover this proves that A^^ is not asymp- 

I 

totically st2d3le if (Aj^, D^^) is not disturbztble, the "only if" 


part of claim (3) . i 


Propoeition 7. If the CCA algorithm using aost-decoupled 
coordinates produces a disturbable pair (Aj^, Dj^) then the fol- 
lowing properties hold: 

(1) Q = Q (the predicted model error index is exact); 

(2) Q is minimized for a given r; 

(3) Q = 0 if r ^ k (the CCA algorithm produces a minimal 
cost-equivalent realization of order k « rank C) . 


Proof, Claim (1) is proven by showing that (58a) holds. 
By virtue of the fact that = 0 (since X in definition 6 is 
diagonal) it follows frcxn (57c) that ^ 0, Hence (58a) is 


I 
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satisfied if F >. Vj^. To show that F >. Fj^ note from (67a) that 

’'b - I ‘iK*:’":®*!' i ' ■ 

i 

Hence, since >. 0 for all i, 

F - Fj^ if r ^ k, k - (rank C) 

F > Fj^ if r < k 

and (1) is proven. The proof of claim (2) follows from (1) 
and theorem 5. Claim (3) follows from claim (1) together with 
(67b) and the fact that can have no more than k ^ 

rank C nonzero eigenvalues. # It may be readily verified 
that proposition 7 holds for the general cost-decoupled co- 
ordinates in definition 6, and proposition 7 is not restricted 
to the special choice of cost-decoupled coordinates given by 
(63) . Furthermore, claim (3) of proposition 7 shows that the 
CCA algorithm using cost-decoupled coordinates yields a cost- 
equivalent realization of (32) if r >. k and if the reduced- 
order model is disturbable. These are only sufficient condi- 
tions. We shall now present the precise conditions in which 
such cost-equivalent realizations are obtained. 

Proposition 8. The CCA algorithm using ooet-dsooupled 
coordinates yields cost~ equivalent realizations of (32) if and 
only if (a) r > k and (b) the undisturbable subspace of (A^, 
Dj^} is unobservable. 

Proof. For any pair (Aj^, Dj^) , the transformation defined 
in (70) exists. (If (A^, is disturbable then I * T » T^, 

All * Aj^, Dj^, and = C^. ) Then from equations (70) and 

(71), it can be seen that Aj^ is not asymptotically stable. 

Those eigenvalues of A^ which are not asymptotically stable 
are contained in the set of eigenvalues of A^ 2 » 
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-•S'*. to tho undisturbabl* nart of •- 

R«nc«, th« undiaturbable modes are the only ones that are not 
asynqE>totlcally stable. Since the unstable (and undlsturbable} 
part of does not contribute to the cost [6] , the model 
(35) can be further reduced to yield 
X, 


Vi' 


(7J) 


such that 


- 1 ^ B\\y^{t) 11^ - 1 ^ 5||y^(t)*||2. 


Now from (71a) and (49) we have 


>'r - “ 


“ CrOCr - •'K»=r»2' 


(73a) 


where the orthonormal property of T(T^T^ + ^2^2 * used. 

Prom (66) R (67a), and the partitioning of C in (55) , it can be 
seen that 

r 


CrOCr 


1 ^iK' 

i-l 


T 

c^Qce. 


34 


Hence , 


•'r - 1 »ihx=^««xl - 

i-1 


(73b) 


where C 2 ^ ^r^2* 


NoWr since from (71b ) , considering 

(70b) to be in observable canonical form [6], it can be said 


that C 2 * 0 if and only if condition (b) holds. Furthermore, 
since the columns of ?2 span the undlsturbable subspace of 


I 


« f 


k 
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°R> 16 ] , w« have the followingi 

(i) if condition (b) holds (equivalently if Cj " 0) then 


2 if r > k 


(74a) 


S ^il®x^^®^®X * ^ if r < k 


(74b) 


(11) if condition (b) does not hold (i.e., ^ 2 ^ ' then 


■'r ■ i ^ 


(74c) 


where a ^ tr C^QCj > 0. Obviously a ■ 0 if Dj^) is dis- 

turbable since [Tj^ Tj] [Tj^] ■ I and [Cj^] -► [Cj^l implying 
C 2 0. Note, therefore, from (74) that if condition (a) does 
not hold, then ^ And (35) is not a cost-equivalent 

realization. # 


One obvious conclusion from proposition 8 is that the 
order of the minimal CER is never less than k, the number of 
Independent outputs. It is of interec;t to classify those sys- 
tems whose minimal CER is of order greater than k. 

Proposition 9. For all systems (32) ythoae first Markov 
Parameters is zero (CD « 0) the order of the minimal CER is 
greater than k. 

Proof. Let the system (55) be in cost-decoupled coordi- 

2 

nates and let r » k. Hence, assuming ■ I, from (66) we have 


T 

C QC 


cJqCr cJqc^ 


0 


0 0 


(75a) 
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i 


wh«r« A diagCA^IC^QC] , Xj (C^QC) » . . . , Xj^lC^QCl). How aine* 
rank C > k, X^[C QC] i< 0, 1 ■ 1, 2,..., k. Hmnem, aquating 

cJqCjj - a*, (75b) 

cJqc^ - 0, (75c) 


and recognizing that Q > 0/ it can then be claimed that Cj^ (of 
dimension k x k) is square and of full rank and that ■ 0. 
Now, since Markov parameters are invariant under similarity 
transformation, we have 


CD 


0 





0 . 


(76) 


Equation (76) is satisfied if and only if Op 0, since is 

Djj) is 

obviously undisturbable. Furthermore, due to full rank of Cj^, 
the pair (C^ 


Dj^) cannot be also unobservable. 
This violates condition (b) of proposition 8. Hence the mini- 
mal CER cannot be of order k. # 

Nevertheless, a minimal CER of order r > k, can be con- 
structed for the systems defined in proposition 9, by in- 
creasing r until condition (b) of proposition 8 is satisfied. 


undisturbable subspace of (A^^, 


■ V completely observable. Therefore, the 


square and of full rank. In this event, the pair (Aj^, 


C, THE ALGORITHM FOR COST-EQUIVALENT 
REALIZATIONS (CER) 

Cost-equivalent realizations (CERs) are provided by the 
CCA algorithm using cost-decoupled coordinates and the CBRs 
have all the properties of propositions 6 and 7. The two 
steps of the basic CCA algorithm are described in Section IV 


I 


. . » 
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th« ooit-d«coupI«d coordinates are dascribad in Section 
VIX.B. Cooblning these two ingredients leads to the following 
CBR algorithm. 

Th9 CSR algorithm 

Stop 1. Given the model and performance objectives of (32) 
and (33) t 

(A, D, C, Q, W) where Q > 0, W > 0, A stable. 

(Choose Oy " I.) 

Stop 2. Ccmtpute covariance X from^ 

0 - XA^ + AX ♦ DWD^. (77) 

2 

stop S. Compute 6^ the square root of X 

X - (78) 

Stop 4, Compute 9^, the orthonormal modal matrix of 
T T 

6xC QC9^. The component costs are 

• diagC/j^, Vy^, 0,..., 0}, (79) 

where the number of nonzero component costs are k ■ rank [c]. 

Stop 5. Rearrange the columns of 9^ so that the appear in 
order 

^ - ^ic* r » k » rank C. (80) 

Stop 6. Then define 9j^ by 

0y - I9j^, 9^1, 9j^ « r"’**'. (81) 


^ For offioiont oolution of tho linoar Liapunov oquation, 
uso tho algorithm in [IJJ. 

9 

For officiant ealoulatvon of 9 . ooo tho oomputor eodoo 
in 112}, 

^For thio task uoo singular valuo doaompooition [9} or uoo 
an oigonvaluo/oigonvoator program opooialisod for oymmotrie 
matrieoo. 
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Stop 7. Coo^ut* 

0* - 


CER. 


C8x®R 


Stop 8, Compute modal data for A|^: 


(82) 


Ap®^ - X^®^, i - 1, 2,.,,, z 

If ||Cjj®^|| > 0 for any i ®uch that “ 0, wh«r® R^(») de- 

notes "real part" of (*) , set r ■ r + 1 and go to step 6. 
Otherwise stop. 


Remark: The product is defined as the oboorvability 

vootor associated with mode 1 (5] (mode 1 In a nondefective 
syston la unobservable If and only If Its observability vector 
Is zero) . Hence, the purpose of step 8 Is to check If the un- 
stable mode (R^^£ “ 0) Is observable. Since In cost-decoupled 
coordinates the unstable modes of Aj^ are also undlsturbable, 
step 8 amounts to checking If the condition (b) of proposition 
8 holds. 

This algorithm guarantees the construction of a CER. How- 
ever, the construction of a minimal CER Is guaranteed only If 
the algorithm converges within the first two Iterations, In 
which case the CER Is of order r-korr-k+1. For the 
minimal CER of order k the triple (A^, Dj^, Cj^) Is both dls- 
turbable and observable and asymptotically stable. For any 
other CER produced by the algorithm, the dlsturbable, observ- 
able spectrim of (A^, Dj^, Cj^) Is asymptotically stable. Aftor 
the first Iteration of the algorithm, the selection of the 
best sequence of eigenvector calculations In step 5 has iK>t 
been determined and Is under investigation. 


If thtt CBR algorltha yialdt « CBR of ordor r with an 
unatablo (and undlsturbabla and unobaarvabla) 8pactna» than 
tha CBR can ba furthar raducad, ao shown in (70) and (72), to 
yiald a raalisation of ordar lose than r. This mallar rMl- 
isation is still a CER as is proved following proposition 8. 

D. RSLATIONSBIPS BBTWBEH TBB COST-DBCOVPLBD 
COOSDIBATBS ABD TBB BALABCBD CCORDIBATBS 
OF HOORB (?} 

The balanced coordinates of Moore (7] are defined by the 
transforaation that diagonalizes the controllability and ob- 
servability matrices (X and K in this paper). Singular value 
analysis provides the efficient tools to cemipute the balanced 
coordinates. As mentioned in the introduction, CCA can be 
applied to any choice of coordinates, including balanced co- 
ordinates. The most powerful results from CCA are obtained 
with the use of the cost-decoupled coordinates defined in the 
last section using the CER algorithm. Moore [7] Introduced 
balanced coordinates to reduce numerical ill-conditioning, 
thereby making data more manageable in the computer. On the 
other hand, the primary goal of CCA is specifically to tailor 
the reduced model to the control or output response objectives 
(36). It would be of interest to know whether there are cir- 
cumstances under which balanced coordinates of Moore are cost- 
decoupled. 

To obtain balanotd coordinates, a coordinate transforma- 
tion is selected so that the new (balanced) coordinates have 
the properties [see Eqs. (37) and (38) in [7]], 


X - K - - diag. 


(83) 


t 
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where X is the disturbablllty matrix 


At *r A t 

e DWD e dt, w > 0 


satisfying 

0 * + AX + DWD^, 

and K is the observability matrix 

K ^ f e^ ^c'^’oce^^ dt, Q > 0 


satisfying 

0 * KA + a\ + Ac* 

To obtain the oost-deaoupled coordinates of Section VII. B, 
a coordinate transformation is selected so that the new (cost- 
decoupled) coordinates have the properties from definition 6, 

X = diag, C^CC = diag, (88) 

To summarize these results from (83) and (88) , proposition 10 
specifies the condition under which cost-equivalent realiza- 
tions can be obtained from balanced coordinates. 

Proposition 10. If in balanced coordinates the state 
weighting C QC happens to be diagonal, then balanced coordi- 
nates are cost-decoupled and hence have all the properties of 
proposition 6. 

Proof, Cost-decoupled coordinates are defined by (88) 
and balanced coordinates satisfy (83) . The comparison of (83) 
and (88) concludes the proof. # 


I 


VIII ^ SHOULD REDUCED MODELS DEPEND 

UPON THE WEIGHTS IN THE QUJU>RATIC COST? 

Th% reader should be reminded of the fact that the state 
T 

weighting [C QC] in the performance metric 

V » lim ff||y||? - lim Ex'^tc'^'ocix 
^ t"** 

often contains parameters chosen in an ad hoo fashion. Why 

then, one might ask, should one adopt a model reduction strat- 

egy in which the reduced models depend upon the weight C QC? 

This question is briefly answered as follows. The selection 

of a performance metric V reflects, to the best of one's 

ability, the objective of the model analysis (to describe ac- 

curately specific outputs y) . Thus, it is important to keep 

in mind that there are many problems in which the entire state 

weighting matrix C^QC is not arbitrary, but only the output 

weighting Q might be free to be manipulated. This notion of 

penalizing only specific physical variables represented by y 

allows the number of free parameters in the n x n state 

weighting C QC to be reduced from n(n + 1) to k(k + 1), the 

T 

free parameters in Q. Thus, C QC contains important informa- 
tion by its very structure. For example, a certain spacecraft 
may have a mission to keep optical line-of-sight errors small 
in a space telescope. These error variables, collected in the 
vector herein labeled y, make up only a small subset of all 
the state variables y » Cx. Alternatively, the same space- 
craft may have a communications mission where one is interested 
in the RMS deflections over the entire surface of a flexible 
antenna. These two problems have entirely diff*r»nf modeling 
(and control) objectives and it i$ preoiatly iha waighta C QC 
that diatinguieh batwean the two objaotivaa. That is, the 


r«ducttd-ord«r B»d*l that la best for the aaalysls (estlaatloaf 
control) of optical errors is different fron the SK>del that is 
best for analysis of errors in the parabolic shape of the an- 
tenna. To ignore these weights C^QC is to force a conplete 
and artificial separation between the control problea and the 
modeling problem, a state of affairs which the authors believe, 
is not realistic. The authors' opinion is that one's ability 
to evaluate the quality of any reduced model (obtained by any 
method) is no better and no worse than his ability to choose 
a precise performance metric. Of course, if one has no physi- 
cal objective to motivate the choice of specific output vari- 
ables y Cx and if he instead arbitrarily chooses an equal 
weighting on all balanoed coordinates (C QC « I) , then the CCA 
algorithm produces the same partial realization as balanced 
coordinate methods of model reduction. A primary goal of this 
chapter is therefore to promote a systematic beginning for the 
integration of the modeling and the estimation/control prob- 
lems, to allow modeling decisions to be influenced by specific 
quadratic control or estimation objectives, without relying 
upon nonlinear programming methods. 

It should also be mentioned that for saalar input-output 
systems the reduced models produced by the CCA algorithm are 
independent of the choices of the output weighting Q and the 
noise intensity W. This can be readily verified by noting 
that 0 and W in (34) and also in (47) are scalars that are 
comnon factors in every component cost V^, and cannot there- 
fore influence the cost ordering (36) . 



IX. STABILITY CONSIOERATIOMS 


Stability aay or nay not be an important feature of a 
reduced model. In fact, several schemes for "improving” re- 
duced models upon which state estimators are based include the 
intentional destabilization of the model as a means to reduce 
or eliminate Kalman filter divergence. This means of im- 
proving models is discussed in [15] and its references. Also 
note that the technique of guaranteeing stability margins in 
linear regulator problems by multiplying the state weight in 
the quadratic cost function by exp(2at) causes the closed loop 
eigenvalues to lie to the left of the line -a in the complex 
plane [16]. This method is also equivalent to intentionally 
destabilizing a stable plant model by replacing A by A t al in 
lieu of multiplying the state weight by exp(2at) . It is not 
our purpose to recommend necessarily such methods for esti- 
mator or control design, but merely to point out that stabil- 
ity is neither a necessary nor sufficient qualification for a 
reduced model to be a "good" model of a stable system. 

The model error index Q is finite if the observable modes 

Cj^) are stable . 

Hence, stability is a sufficient but not a necessary condition 
for the existence of Q. If stability is an overriding concern 
in the selection of a partial realization, then one may choose 
special coordinates for which the CCA algorithm guarantees 
stability. 

Presently, if the order of the partial realization is 
fixed a priori, the only coordinates for which asymptotic sta- 
bility of the partial realizations produced by CCA has been 
guaranteed is modal coordinates. The modal cost analysis (MCA) 


of (A, C) and the observable modes of (Aj^, 


f 


I I 

of Section V produces stable models since the eigenvalues of 
the reduced model are a subset of the eigenvalues of the orig- 
inal (stable) system. However, since other coordinate choices 
(such as the cost-equivalent coordinates of Section VII) may 
produce better models, it is suggested that the CER be found 
first and ex^uDined for stability. If stability of the reduced 
model is required and not obtained from the CER, then obtain 
the reduced model by application of MCA, which guarantees 
stability. Note, however, that if both realizations (from CER 
and MCA) of order r are stable, the authors have not found a 
single example in which the CER failed to yield a smaller 
model error index Q. 

Furthermore, if the order of the partial realization is 
not fixed a priori, then the CER algorithm always yields a CER 
that is asymptotically stable. 

X. CER EXAMPLES 

The concepts are best illustrated with simple problems. 

We begin with a second-order example. 

Example 1. The CER for the system (32) with pareuneters 



C « (1, -0.2), W * I 


with transfer functions 
y (s) ■ G(s)w(s) , 

G(s) « l(s + 1) (s + 10)l"^l-13s - 4, 0.8s 9.8] 

is 

Aj^ - -10.318, Cj^ - -2.867, « 14.534, -0.2791 , 


ijfUni'n'" 
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. ? 


.-1 


which has tha transfer function 

y(s) - Gjj(s)w(s), Gj^(s) - [-13, 0.81 t(s + 10.33)1 

The reduced-order nK>del has an eigenvalue near the fast node 
(-10) of the original system as a consequence of the fact that 
this mode is highly disturbable from w(t). 

Example 2. Several authors on model reduction have cited 
the fact that tliere seems to be no simple way to say that 

G(s) - (s + D(s + 10) “ FTTC* 

We consider a little more general sitliation: We find that for 

, . s + o 

“ Ts V I) is +■ 10) 

the minimal CER is 

1 


Gj,(s) = 


s + 


TTS • 


10 + a‘ 

Table I provides the results for a variety of choices of a, 
and the corresponding CER. The table illustrates (for a » 1, 
1.1, 10) the proper use of zero information in a near 


Table I. 


a 

Example 0(8 ) 

Gj^(b) of CER 

2 


8 + 1 


1 

( 8 

+ 1)(b + 

~TdJ 

8 + 10 

1. 1 


8 + 1.1 


1 

( 8 

+ 1)(8 + 

~W 

8 + 9.8 

10 


8 + 10 


1 

( 8 

+ 1) (8 + 

10 

8 + 1 

-10 


8-10 


1 

( 8 

+ 1)(8 + 

10) 

8 + 1 

- 1 


8 - 1 


1 

(8 

+ 1) (8 + 

10) 

8 + 10 

0 


8 


1 

( 8 

+ 1) (8 + 

~TU 

8 + 11 


I— / 




1 
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pole-zero cancellation situation-<- a situation .^at_Crttstt^at:ep 
many model reduction schemes. The reader is roninded that for 
scalar input<‘Output systems, the CER parameters (A^, D|^, C^) 
are independent of the noise intensity W > 0 and output 
weighting Q > 0. 

Example 3. Consider the following system whose first 
Markov parameter is zero (i.e., CD >> 0} 

X = Ax + Dw, w ~ N(0, 1) 


y 

where 


Cx 



■-10 1 0' 


‘O' 

A = 

- 5 0 1 

n 

a 

1 


1 0 0. 


_1. 


C = [1 0 0] 


From proposition 9 a minimal CER of order 1 does not exist for 
this system. However a CER of order 2 exists and is given by 


* °h” 


^R * Vr' 


where 


0 0.7384 

1-0.7384 -8.166 

(0.335, 0] . 


°R = 


0 

4.0413 


This CER is asymptotically stable, disturbable and observable. 
XI. APPLICATION OF CCA TO CONTROLLER REDUCTION 


Given a model of high-order n > n , the traditional 

W 

approach to designing a linear controller of specified order 

n is first to use model reduction methods to reduce the model 
c 

to order n^ and then design a controller that is perhaps 
optimal for the reduced model. There are at least two 


objections to this strategy. The first disadvantage is that 
»ost 8K>del reduction techniques ignore the effect of the (yet 
to be determined) control inputs# and it is well known that 
the inputs (whether they be functions of time or state) can 
have a drastic effect on the quality of the reduced model. 

The second disadvantage is that optimal control theory ai^lied 
to a poor model can certainly yield poor results# often de- 
stabilizing the actual system to which the low-order "optimal" 
controller is applied. 

The design strategy suggested for obtaining a controller 
of order n given a model of order n » n is as follows: 

w W 

k oontroller-reduotion algorithm 

1. Apply CCA to reduce the model to order N_ > n # where 

K C 

is the largest dimension of a Riccati equation that can be 
reliably solved on the local computer. 

2. Solve for the optimal controller of order N^^# using 
the .educed model of order 

3. Apply CCA to reduce the oontroller to order n^ < 

The purpose of this section is to show how to accomplish 
step 3. The intended advantage of this algorithm over the 
traditional approach (which skips step 3 and sets ” n^) is 
that more information about the higher order system and its 
would-be optimal controller is made available for t*'s design 
of the reduced-order controller. 

The controller reduction can be presented as a restricted 
model reduction problem as follows: Consider the plant# 

X • Ax + Bu + Dw, 

y - Cx# (89) 

Z ■ MX + V# 
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X t r", u € R®, w e R^, 

V • 

y e R , s e R , rk[B] > ro <L n, 
where w(t) and v(t) are uncorrelated zero-mean white nolee 
processes with intensities W > 0 and V > 0, raspectively. The 
measurement is z, y is the output to be controlled, and u is 
the control chosen to minimize 

F - Urn F(||y||^ + ||u||r), Q > 0, R > 0. (90) 

t->* 

Under the assuroptims that (A, B) and (A, D) are control- 
lable, (A, C) and (A, M) observable, the optimal controller for 
(89) ta)ces the form 


+ Fz , € r”, 

c c c c 


u » Gx^, 


Ola) 


A^ ^ A + BG - PM, 


(91b) 


G = -r"^b^k, ka +a'^k - kbr"^b^k + c'^’oc » 0, (9: 

F = pm'^v"^, pa*^ + ap - pm'^v"^mp + dwd'*’ » 0. (9: 

Augmenting the plant (89) and the controller (91) yields 
the closed- loop system. 

“IH 


^ he 


0 F V 


ch: :ii, 


The cost V can be expressed as 
V « tr Xj^j^c'^QC + tr X^jC'^RG, 


I 

i 


L 


t 


\ 

i 
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wh«r« 


*11 *12 


■ A* mV 


A 

< 

1 


*11 *12 








^12 Xj2. 


gV a* 


1 

•S 

X 

1 


A 

*12 *22. 


+ 


T 

DWD 

0 



(96) 


Now if the two ”c<»c|>onente* of (90) are defined at the plant 
(with state x) and the controller (with state x ^) , then the 
ccxnponent costs for x and x are denoted V* and V^, 

w 

respectively, where 

y - + y® (97) 


and 

V* ^ tr 


(98) 


V® ^ tr XjjG^RG. 


(99) 


Since we desire to reduce the dimension of the controller and 
not the plant, we further decompose into individual compo- 
nent costs associated with controller states, 
n 

V • V* + ^ kJ, (100) 

i»l 


where 


kJ a (*22°^*'®)ii- 

Having defined the controller components, the controller 
reduction can be shown to be a special "model reduction* prob- 
lem by simply interpreting (90) in the form of (32). That is. 




I 


. . * t 
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■ubstltut* 




A BG 


PM A. 


T T 

y « 


D 0 


0 P 


I w o' 

0 V 


[ Q o' 

0 R. 


C 0 


0 G 


Now with a very minor modification the standard CCA algorithm 

can be applied to obtain the reduced-order model of dimension 

N ■ n n , where n is the dimension of the reduced-order 
c c c 

controller desired. The minor restriction is that the plant 
component of dimension n is not to be truncated, regardless of 
the value of V*, 

Motivated by the theory of cost-decoupled coordinates, CERs 
and definition 6 , we desire to transform the controller co- 
ordinates so that both X 22 and G RG in (97) are diagonal. 

The ooet-deooupled aontroller (CDC) algorithm 

Step 1. Given the model and performance objectives (A, B, D, 
C, M, W, V, Q, R) . 

Step 2. Compute the optimal controller (A , F, G) from (91)- 

w 

A ^ 

(93) and the covariances and X 22 satisfying (96). 

A 

Step 3. Compute 6 ^ the square root of X 22 

^.2 - ®i®I 

T T 

Step 4. Compute 62 the orthonormal modal matrix of 6 j^G RGO^. 
The controller component costs are 

O^ 9 jG'*'RG 0 j^e 2 - diagiPj, V^, . . . , V^, 0 ,... 0 ) 


where the number of nonzero controller component costs are m 


rank B 


I I 

QF POOR 

8t0p 6. X«arrat^e th« coltmns of 82 to that tlM appoar in 
ordar 

Kfi r'. 

Than define Gj^ by 

®2 " ^®R' ®T^' ®R * • 

Step 6, The reduced COC is 

^ * Vr + V' *R ‘ 

“ ' °R*R' 

Where 

*R * ®K\® 1 ®R' 

^R ^ ®R®I^^' 

®R ‘ =® 1 ®R- 

Additional properties of the CDC must be explored in 
future investigations. Space limitations suggest this con- 
venient stopping point in the presentation of the CER theory 
and its application to both model and controller reduction. 

XII. CONCLUSIONS 

A summary of the ideas of cost decomposition is given to 
aid in the determination of the relative cost (or "price") of 
each component of a linear dynamic system using quadratic per- 
formance criteria. In addition to the insights into system 
behavior that are afforded by such a exponent cost analysis 
(CCA ) , these CCA ideas naturally lead to a theory for cost- 
equivalent realisations. 


Cost-«quival«nt raalisatlons (CERa) of llnaar ayatana ara 
daflnad, and an algorlthn for thair conatructlon la glvan. 

Tha partial raaliiationa of ordar r producMl by thla algor itlw 
hava thaaa propertlaat 

1. a minimized model error index; 

2. the nK>del error index la zero (i.a., the original aya- 
tern and the partial realization have the aama value of the 
quadratic performance metric ) , it x > k, where k ia the number 
of independent outputs; 

3. the algorithm does not require the computation of modal 
data of the plant matrix A; 

4. the method is applicable to large-'Scale systems » 
limited only by the necessity to solve a linear Liapunov- type 
algebraic equation; 

5. the CER algorithm produces stable realizations of a 
stable syst«n. 

The algorithm is based upon component cost analysis (CX!A ) , 
which is described for time-varying systttns, for time-invariant 
systems, and for systems for which accurate modeling is of 
concern only over a finite interval of time. These ccmponent 
costs are shown herein to be useful in obtaining the above 
cost-equivalent realizations, but they are also useful in 
closed-loop applications where controllers, rather than models, 
are to be simplified. 

Property 2 above reveals that cost-equivalent realizations 
can be »mall*r than Kalman's minimal realization, which is 
always of the dimension of the controllable, observable 
subspace . 


section VI la a point of dapartura for furthar rasaarch 
using diffarant nodal arror critarla. Inetaad of using tha 
diffaranca of noms as in (48) , an arror critarion using tha 
norm of tha diffarancas can ba stud! ad much mora axtansivaly 
than dona in [51# whara only Input** inducad c<»tponant costs 
ware usad. Tha modal arror critarion utilizad harain# (48 ) , 
is chosan for its appropriatanass to tha raduction of optimal 
controllars. Othar usas of conponant cost analysis (^!A) # 
which warrant furthar rasaarch includa decantralisad control# 
failura analysis# and systam redasign stratagies basrd upon 
”cost-t>alancing . " 
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